Adaptive two-layer ReLU neural network: II. Ritz approximation to elliptic PDEs
نویسندگان
چکیده
• Proposing a self-adaptive algorithm (ANE) for designing nearly optimal two-layer NN solving PDEs. A method of continuation by the ANE providing good initialization in training neural network. Analyzing effect numerical integration. Introducing posteriori error estimators recovery type method. Demonstrating superior performance problems with interface singularities and sharp interior layers. In companion paper [1] , we introduce adaptive network enhancement best least-squares approximation to target function using ReLU networks (NNs). this paper, apply self-adjoint second-order elliptic partial differential equations (PDEs). The underlying PDE is discretized Ritz spline based on either primal or dual formulations that minimize respective energy complimentary functionals. Essential boundary conditions are imposed weakly through functionals proper norms. It proved norm; moreover, integration analyzed as well. Two neuron introduced, one so-called estimator other estimator. Finally, results diffusion corner intersecting presented.
منابع مشابه
Convergence Analysis of Two-layer Neural Networks with ReLU Activation
In recent years, stochastic gradient descent (SGD) based techniques has become the standard tools for training neural networks. However, formal theoretical understanding of why SGD can train neural networks in practice is largely missing. In this paper, we make progress on understanding this mystery by providing a convergence analysis for SGD on a rich subset of two-layer feedforward networks w...
متن کاملGalerkin approximation for elliptic PDEs on spheres
We discuss a Galerkin approximation scheme for the elliptic partial differential equation −∆u+ ω2u = f on Sn ⊂ Rn+1. Here ∆ is the Laplace-Beltrami operator on Sn, ω is a non-zero constant and f belongs to C2k−2(Sn), where k ≥ n/4 + 1, k is an integer. The shifts of a spherical basis function φ with φ ∈ H τ (Sn) and τ > 2k ≥ n/2 + 2 are used to construct an approximate solution. An H1(Sn)error ...
متن کاملA new embedding result for Kondratiev spaces and application to adaptive approximation of elliptic PDEs
In a continuation of recent work on Besov regularity of solutions to elliptic PDEs in Lipschitz domains with polyhedral structure, we prove an embedding between weighted Sobolev spaces (Kondratiev spaces) relevant for the regularity theory for such elliptic problems, and TriebelLizorkin spaces, which are known to be closely related to approximation spaces for nonlinear n-term wavelet approximat...
متن کاملSparse adaptive Taylor approximation algorithms for parametric and stochastic elliptic PDEs
The numerical approximation of parametric partial differential equations is a computational challenge, in particular when the number of involved parameter is large. This paper considers a model class of second order, linear, parametric, elliptic PDEs on a bounded domain D with diffusion coefficients depending on the parameters in an affine manner. For such models, it was shown in [11, 12] that ...
متن کاملNonlinear Approximation and Adaptive Techniques for Solving Elliptic Operator Equations Multiscale Wavelet Methods for Pdes
w I n t r o d u c t i o n Adaptive methods are an important tool for numerically solving elliptic equations. Their origins appear in the adaptive grid refinements in finite element methods. Heuristically, adaptive methods are effective when trying to recover solutions u which exhibit singularities. Much impetus to the theory of adaptive finite element methods was provided by the introduction M ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Computers & mathematics with applications
سال: 2022
ISSN: ['0898-1221', '1873-7668']
DOI: https://doi.org/10.1016/j.camwa.2022.03.010